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DETAILED ACTION 

1 . This action is in response to Amendment C filed 10/3 1/2003. 

2. As per Applicant request, claims 1, 10, 18 and 22 are amended. Claims 1-18 & 20-22 are 
pending. 

3. As Applicants point out under Remarks / Arguments section, of Amendment filed on 
October 29, 2003 (paper #13), at page 7, 3 rd paragraph, the previous Final Rejection (paper #12), 
mailed July 31, 2003, is hereby withdrawn, as it was not necessitated by amendment of the 
claims nor based on information submitted in an information disclosure statement. However, 
Applicants' amendments and arguments (paper #13), have been fully considered, but they are not 
persuasive, as now the amended claims subject matter will be addressed below. Accordingly, 
this action is made Final. 

Specification 

4. The amended Specification, in Amendment B, dated 07/08/2003, has been entered. 

5. In view of the amendments to the Specification, previous objections to the Specification 
are hereby withdrawn. 

Double Patenting 

6. Per Applicant's response in Amendment A, filed 01/21/2003, Applicant agrees to file a 
terminal disclaimer associated with co-pending application, 09/548203, upon indication of 
allowance. 

Claim Rejections - 35 USC § 112 

7. The 35 USC 1 12 rejection is withdrawn in view of the cancellation of claim 19. 

Claim Rejections - 35 USC § 103 



Application/Control Number: 09/482, 1 78 Page 3 

Art Unit: 2122 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

9. Claims 1-18 and 20-22 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent 5,974,572 to Weinberg et al., in view of U.S. Patent 6,574,578 to Logan. 

Weinberg disclosed a Web site (server) analysis program implemented as a collection of 
software components. Weinberg's invention generates test scenarios (col. 2, lines 38-39 and col. 
3, line 7) that emulates multiple concurrent users on the system. Weinberg specified that the 
content tested is objects (components) (col. 6, lines 8-15) and that a user can retrieve a URL 
(content object) from the server (col. 10, lines 7-9.) 

Weinberg did not provide extensive details concerning the testing of individual 
application components. However, Logan did disclose more specific details regarding 
application components (Col. 2, lines 19-22 and col. 6, lines 52-54) and the utilization of a server 
to coordinate testing. 
Per claim 1: 

-a) providing test code that exercises said technology based software component of the 
application under test; (Logan, col.), lines 25-31, "...integrated environment for component 
testing..." Additionally, Logan disclosed, "technology based software components" at col. 6, 
lines 52-56, "When testing components, e.g., JAVABeans...") 
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-b) synchronizing and executing a plurality of instances of the test code, wherein said test code 
accesses said technology based software component of the application under test over said 
computer network and recording performance data on said technology based software 
component of the application under test; (Logan, col.), lines 17-24, . .The test suites are run 
locally . . . and the outcomes of the test cases are stored. . .) 

-c) repeating step b) multiple times, with a different number of instances of the test code; 
(Logan, col.), line 29, ". ..repeating an established suite of tests.. .") 

-d) analyzing the recorded performance data to indicate a performance characteristic of said 
technology based software component of the application under test in response to load. (Logan, 
col. 7, line 47-49, ". . .generates the test results transaction. . .posted to the database server. . .") 
Therefore, it would have been obvious, to one of ordinary skill in the art, at the time of 
the invention, to modify Weinberg's invention which generates a load test on a server by 
including Logan's invention which disclosed more details regarding the testing of application 
components (col. 2, lines 39-47) in a distributed environment (fig. 1), because extensive testing 
of components is useful in comparing expected outcome versus actual outcome, interactive tests 
can provide feedback, and checklist testing can ensure quality checks are performed in a 
complete and consistent manner (Logan, col. 7, lines 25-40). 
Per claim 2: 

-the step of providing test code includes generating test code automatically. (Weinberg, Col. 33, 
lines 47-50, . .a code module is provided that automatically generates a load testing 
scenario...") 
Per claim 3: 
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-application under test is an object oriented language and the step of providing test code 
comprises providing test code to exercise one software component of the application. 
(Weinberg, col. 11, lines 61-67, col. 19, lines 60-64, and col. 20, lines 4-7. ) 
Per claim 4: 

-the step of synchronizing comprises starting each instance of the test code at the same time. 
(Weinberg, Col. 20, lines 22-26, "A task manager process. . .handles issues related to the 
management of the threads, including the synchronization. . ."). 
Per claim 5: 

-the step of synchronizing and executing comprises executing a portion of the plurality of 
instances of test code on a first computer and a portion of the plurality of instance of test code on 
a second computer connected to the network. (Weinberg, Fig. 25 and col. 32, lines 51-58, 
"...multiple Vusers (i.e., multiple instances of the Vuser executable) can be run simultaneously 
on a single workstation. . .This produces a load in which multiple client requests can. . .be pending 
at-a-time..."). 
Per claim 6: 

Preparing a graphical display having as an independent variable the number of instances of the 
test code and the dependent variable is the performance data. (Weinberg, Fig. 26 and col. 18, 
lines 64-67, ".. .the Action Tracker plug-in communicates with the Web sites. . .to retrieve server 
access log files for performing Web site activity analyses. Also, col. 33, lines 3-8, ". . .user is 
presented with a set of graphical reports that allow the user (to) evaluate the site's 
performance... 5 ') 
Per claim 7: 
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Preparing a graphical display having as an independent variable the number of instances of the 
test code and the dependent variable is derived from the performance data. (Weinberg, Fig. 26, 
col. 32, line 64 - col. 33, line 8, . .records various performance-related characteristics of these 
responses. These characteristics include. . .response times to individual client requests. . .the user 
is presented with a set of graphical reports. . .the user can. . .compare response times of different 
site components...") 
Per claim 8: 

Weinberg disclosed a Web site (server) analysis program implemented as a 
collection of software components. Weinberg's invention generates test scenarios (col. 2, lines 
38-39 and col. 3, line 7) that emulates multiple concurrent users on the system. Weinberg 
specified that the content tested is objects (components) (col. 6, lines 8-15) and that a user can 
retrieve a URL (content object) from the server (col. 10, lines 7-9.) 

Weinberg did not provide extensive details concerning the testing of individual 
application components. However, Logan did disclose: 

-application under test is resident on a first server within the network and the application has a 
remote interface and the test code is resident on at least a second computer within the network 
and exercises the software component of the application under test using the remote interface of 
the application under test. (Logan, col. 7, lines 41-49, "...client instantiates the software objects 
being tested. . .passes to . . .server. . ." Also see fig. 1.) 

Therefore, it would have been obvious, to one of ordinary skill in the art, at the time of 
the invention, to modify Weinberg's invention which generates a load test on a server by 
including Logan's invention which disclosed more details regarding the testing of application 
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components (col. 2, lines 39-47) in a distributed environment (fig. 1), because extensive testing 
of components is useful in comparing expected outcome versus actual outcome, interactive tests 
can provide feedback, and checklist testing can ensure quality checks are performed in a 
complete and consistent manner (Logan, col.7, lines 25-40). 
Per claim 9: 

-The step of analyzing includes displaying the analyzed data to a human user using a graphical 
user interface. (Weinberg, Col. 33, lines 3-4, "the user is presented with a set of graphical 
reports...") 
Per claim 10: 

Weinberg disclosed a Web site (server) analysis program implemented as a 
collection of software components. Weinberg's invention generates test scenarios (col. 2, lines 
38-39 and col. 3, line 7) that emulates multiple concurrent users on the system. Weinberg 
specified that the content tested is objects (components) (col. 6, lines 8-15) and that a user can 
retrieve a URL (content object) from the server (col. 10, lines 7-9.) 

Weinberg did not provide extensive details concerning the testing of individual 
application components. However, Logan did disclose: 
-a) specifying test conditions through a user interface to a test system; 

-b) initiating, across a network, through a user interface to the test system the gathering of test 
data on the performance of at least one technology based software component of the application 
under test at a plurality of load conditions; (See Logan, figs. 7 & 1 1, networked testing.) 
-c) specifying through a user interface to the test system the output format of the test data; 
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-d) displaying in the specified format the response of said at least one technology based software 
component of the application under test to load. 

(Logan, col. 7, lines 41-60, and fig. 6, "...AdriverPanel constructs a TestFrame frame window 
that contains a TestingPanel object which, in turn, contains any graphical elements of the 
component software being tested..." And Col. 6, lines 52-56, JAVABeans.) 

Therefore, it would have been obvious, to one of ordinary skill in the art, at the time of 
the invention, to modify Weinberg's invention which generates a load test on a server by 
including Logan's invention which disclosed more details regarding the testing of application 
components (col. 2, lines 39-47) in a distributed environment (fig. 1), because extensive testing 
of components is useful in comparing expected outcome versus actual outcome, interactive tests 
can provide feedback, and checklist testing can ensure quality checks are performed in a 
complete and consistent manner (Logan, col.7, lines 25-40). 
Per claim 11: 

-the specified format is a graphical format indicating response time as a function of load 
conditions. (Weinberg, Col. 33, line 3-4, ". . .the user is presented with a set of graphical 
reports...") 
Per claim 12: 

-the specified graphical format is a Hi-Lo plot. (Weinberg, Col. 33, line 3-4, . .the user is 
presented with a set of graphical reports. . ."). 
Per claim 13: 

-the step of gathering data under a plurality of load conditions comprises initiating the execution 
of a plurality of copies of a test program, with the number of copies executing simultaneously 
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relates to the load condition. (Weinberg, Col. 33, lines 24-39, "To define a scenario, the user 
initially uses the Web Vuser Generator component to generate the Web scripts to be included 
within the scenario. . .the user specifies such details as the number of Vusers, the Web script to be 
run. . .and the number of consecutive times. . .The user can also define one of more Sgroups, and 
can specify various testing parameters. . ."). 
Per claim 14: 

-the step of specifying an output format includes specifying a method by which response is 

measured. (Weinberg, Col. 32. line 64 - col. 33, line8, "Vuser monitors the Web site's 

responses to the client requests submitted by that Vuser, and records various performance-related 

characteristics of these responses... These characteristics include, for example, response 

times. . .user is presented with a set of graphical reports that allow the user (to) evaluate the site's 

performance... 55 ). 

Per claim 15: 

-the step of gathering test data includes recording the execution time between selected points in 
the test program for each simultaneously executing copy of the test program and analyzing the 
recorded execution times for all copies of the test program. (Weinberg, Col. 33, line 5-6, 

. .user can. . .compare response times of different site components. . , 55 ). 
Per claim 16: 

-the step of analyzing comprises determining the average and maximum execution times for each 
of the load conditions. (Weinberg, Col. 32. line 64 - col. 33, line8, "Vuser monitors the Web 
site's responses to the client requests submitted by that Vuser, and records various performance- 
related characteristics of these responses... These characteristics include, for example, response 
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times. . .user is presented with a set of graphical reports that allow the user (to) evaluate the site's 

performance...") 

Per claim 17: 

-the computerized application under test comprises software resident on a server controlling 
access to a computerized database; (Weinberg, Col. 3, lines 5-15, ". . .based on information 
stored within a server access log file. The server access log file is . . .generated by. . . Web server. 
These log files contain information about accesses..." Also see fig. 13, item 180 and col. 25, 
lines 3-11,"... specifies . . . other Web server extension component 1 80 to which the form is 
addressed. . .Astra extract the dataset. . .") 

-the server is connected to a network and the application under test is simultaneously accessed by 
a plurality of clients over the network; (Weinberg, Fig. 1 1 and fig. 25) 

-the test system is resident on at least a second server connected to the network. (Weinberg, Figs. 
11 &25) 
Per claim 18: 

Weinberg disclosed a Web site (server) analysis program implemented as a 
collection of software components. Weinberg's invention generates test scenarios (col. 2, lines 
38-39 and col. 3, line 7) that emulates multiple concurrent users on the system. Weinberg 
specified that the content tested is objects (components) (col. 6, lines 8-15) and that a user can 
retrieve a URL (content object) from the server (col. 10, lines 7-9.) 

Weinberg did not provide extensive details concerning the testing of individual 
application components. However, Logan did disclose: 
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-a) providing test code to exercise a selected technology based software component: (Logan, fig. 
5 and col. 6, lines 59-64, . .test code generator software program. . .to generate . . .test" Also, 
col. 6, lines 52-56, JAVABeans.) 

-b) creating a first plurality of copies of the test code; (Logan, col. 6, line 67 - col. 7, line 1, 

. .test case code generator generates the skeleton test cases by way of the java.introspection 
facility...") 

-c) simultaneously executing the first plurality of copies of test code while recording times 
between events in each of the first plurality of copies of test code, wherein said test code 
accesses said technology based software component over the computer network; (Logan, col. 7, 
lines 30-35. See "background automates tests." Figs. 1 & 3 show networked accesses.) 
-d) creating a second plurality of copies of test code; (Logan, col. 7, lines 16-20, ". . .a skeleton 
test suite program is generated that can then be individualized for specific test cases of the 
component and integrated into the testing execution framework to automatically execute each 
test case and post test results. . .") 

-e) simultaneously executing the second plurality of copies of test code while recording times 
between events in each of the second plurality of copies of test code; (Logan, col. 2, lines 42-47, 
"Testing tools include facilities for: developing and executing suites of related test cases.. .") 
-f) repeating a predetermined number of times the steps of creating plural copies of the test code 
and simultaneously executing the plural copies while recording event times; (Logan, col. 4, lines 
57-60, and col. 6, line 29, "...repeating an established suite of tests...") 
-g) analyzing the recorded times to present information on the performance of the technology 
based software component of the application under test as a function of load. (Logan, col. 7, 
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lines 33-34, . .comparison between the expected outcome and the actual outcome can be 
performed...") 

Therefore, it would have been obvious, to one of ordinary skill in the art, at the time of 
the invention, to modify Weinberg's invention which generates a load test on a server by 
including Logan's invention which disclosed more details regarding the testing of application 
components (col. 2, lines 39-47) in a distributed environment (fig. 1), because extensive testing 
of components is useful in comparing expected outcome versus actual outcome, interactive tests 
can provide feedback, and checklist testing can ensure quality checks are performed in a 
complete and consistent manner (Logan, col.7, lines 25-40). 
Per claim 20: 

Weinberg disclosed a Web site (server) analysis program implemented as a 
collection of software components. Weinberg's invention generates test scenarios (col. 2, lines 
38-39 and col. 3, line 7) that emulates multiple concurrent users on the system. Weinberg 
specified that the content tested is objects (components) (col. 6, lines 8-15) and that a user can 
retrieve a URL (content object) from the server (col. 10, lines 7-9.) 

Weinberg did not provide extensive details concerning the testing of individual 
application components. However, Logan did disclose: 

-software component has a plurality of functions therein and the test code exercises functions of 
the software components. (Logan, col. 6, lines 61-63, ". . .generate a basic core API test skeleton 
program that systematically exposes all protected methods. . .") 

Therefore, it would have been obvious, to one of ordinary skill in the art, at the time of 
the invention, to modify Weinberg's invention which generates a load test on a server by 
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including Logan's invention which disclosed more details regarding the testing of application 
components (col. 2, lines 39-47) in a distributed environment (fig. 1), because extensive testing 
of components is useful in comparing expected outcome versus actual outcome, interactive tests 
can provide feedback, and checklist testing can ensure quality checks are performed in a 
complete and consistent manner (Logan, col. 7, lines 25-40). 
Per claim 21: 

Weinberg disclosed a Web site (server) analysis program implemented as a 
collection of software components. Weinberg's invention generates test scenarios (col. 2, lines 
38-39 and col. 3, line 7) that emulates multiple concurrent users on the system. Weinberg 
specified that the content tested is objects (components) (col. 6, lines 8-15) and that a user can 
retrieve a URL (content object) from the server (col. 10, lines 7-9.) 

Weinberg did not provide extensive details concerning the testing of individual 
application components. However, Logan did disclose: 

-the events at which times are recorded includes times at which commands are issued to access 
functions of the software components and times at which execution of the commands are 
completed. (Logan, col. 7, lines 25-40.) 

Therefore, it would have been obvious, to one of ordinary skill in the art, at the time of the 
invention, to modify Weinberg's invention which generates a load test on a server by including 
Logan's invention which disclosed more details regarding the testing of application components 
(col. 2, lines 39-47) in a distributed environment (fig. 1), because extensive testing of 
components is useful in comparing expected outcome versus actual outcome, interactive tests 
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can provide feedback, and checklist testing can ensure quality checks are performed in a 
complete and consistent manner (Logan, col. 7, lines 25-40). 
Per claim 22: 

-a) coordination software; (Weinberg, Abstract lines 1-4 and Logan, col. 2, lines 19-22.) 
-b) at least one code generator, receiving as an input commands from the coordination software 
and having as an output client test code; (Weinberg, Abstract, lines 20-22, "A Load Wizard 
module uses this activity data to generate testing scenarios. . .") 

-c) at least one test engine, receiving as an input commands from the coordination software, the 
test engine comprising a computer server having a plurality of threads thereon, each thread 
executing an instance of the client test code, wherein said client test code accesses said 
technology based software component over a computer network; (Weinberg, figs. 25&30. See 
figs. 7 & 1 1 for examples of network accesses.) 

-d) at least one data log having computerized memory, the memory holding timing data created 
by the instances of the client test code in the plurality of threads; (Weinberg, col. 32, lines 64- 



-e) at least one data analyzer software, operatively connected to the data log, having an output 
that represents performance of the technology based software component of the application 
under test in response to load. (Weinberg, col. 33, lines 3-4, ". . .user is presented with a set of 
graphical reports. . . ") 



10. Applicant's amendments and arguments filed 29 October 2003 (paper #13) have been 
fully considered but they are not persuasive. 



67.) 



Response to Arguments 
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(A) Applicants have argued, in substance, the following: 

As noted on page 8, fourth paragraph, of Amendment C (paper #13) , dated 29 October 
2003, Weinberg fails to disclose or suggest the testing of technology based software components 
over a network. 

Examiner's Response: 

Weinberg does disclose testing "technology based software components" over a 
"network". Weinberg's invention disclosed generating test scenarios (col. 3, lines 6-7). 
Weinberg disclosed content as (col. 6, lines 11-13) "content objects include HTML documents, 
GIF files, sound files, video files, JAVA applets arid aglets, and downloadable 
applications.. .(technology based software components)" 

(B) Applicants have argued, in substance, the following: 

As noted on page 8, fourth paragraph, of Amendment C (paper #13), dated 29 October 
2003, Logan fails to disclose or suggest the testing of a technology based software component 
over a network. 

Examiner's Response: 

Logan disclosed (Abstract, lines 1-2) "utilizing a server to coordinate component testing 
in an integrated test environment network. . ." Logan disclosed (col. 6, lines 52-56, "When 
testing components, e.g., JAVABeans, each executable class within the component must be 
tested." Additionally, see figs. 1 & 3 regarding a networked environment. 



Conclusion 
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1 1 . Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 



12. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

U.S. Patent No. 4,617,663 to Lake et al., (Interface testing of Software systems, 
generating software scripts.) 

U.S. Patent No. 5,671,351 to Wild et al., (System and method for automated testing and 
monitoring of software applications, outputs report.) 

U.S. Pat No. 5,812,780 to Chen et al., (Method and system and product for assessing a 
server application performance. Fig. 7 & col. 15, line 65 - col. 16, line 55, ". . .analysis of the 
simulation results represented by the task response times found in the log file occurs at 
performance analysis step 66...." & col. 15, line 36-col. 16, line 51, "Once atask is completed, 



• 
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the total time for completion is calculated at log response times . . .After the execution of the user 
load simulation... analysis of the simulation results . . .found in the log file occurs at performance 
analysis step 66. Performance analysis. . .comprises ordering the response times. . .other response 
time based statistics could advantageously be used as part of he present invention. . .weighted 
average response time. . .Network administrators may make graphs. . . " & col. 1 6 5 lines 6-7, 
". . .ordering the response times. . .from the quickest to the longest. . .") 

U.S. Pat No. 5,881,269 to Dobbelstein, (Simulation of multiple local area network clients 
on a single workstation.) 

U.S. Pat No. 6,002,871 to Duggan et al., (Multi-user application program testing tool.) 
13. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mary Steelman, whose telephone number is (703) 305-4564. The 
examiner can normally be reached Monday through Thursday, from 7:00 A.M. to 5 :30 P.M. If 
attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Tuan 
Dam can be reached on (703) 305-4552. 

The fax phone numbers are (703) 872-9306 for regular communications and for After 
Final communications. Any inquiry of a general nature or relating to the status of this 
application or proceeding should be directed to the receptionist whose telephone number is (703) 
305-3900. 
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